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The applicant is aware of several attempts to design and patent a system, 
each of which appears to have had little if any commercial success and each of 
which suffers from significant deficiencies. 

One such system is described in U.S. Patent 5.489.886 of Wexler et al. 
That system requires up to 30 specially designed cameras to monitor the court and 
feed data into a processor. Given the huge amount of data generated by 30 such 
cameras, a super computer would be required. The Wexler et al. system also 
requires a camera placed under the net. In addition to the camera placed on each 
of the lines, which could interfere with the normal play of the game. The cost of 
such a system, if it worked, would be prohibitive to all but the hosts of the world's 
largesttournaments, such as Wimbledon. To the applicant's knowledge, however, 
this system did network, and has never worked acceptably because of the lack of 
a suitable computer processor for the task. 

Other examples known to the applicant include U.S. Patent 4,432.058 of 
Supran, which requires that the ball be conductive and the court be equipped 
with electrical circuits, U.S. Patent 4,866.414 of Diaconu et al. which requires 
the players to adapt their shoes and socks to the system and U.S. Patent 
4,893,1 82 of Gautrand et al., which is designed for a static scene such as a 
bowling alley and thus would not function in a high speed game such as tennis. 

It is therefore an object of the present invention to provide a system and 
method for judging boundary lines, which system is capable of processing and 
interpreting the movements of objects (most often balls), atpotentially high speeds, 
thus enabling the automatic overseeing and judging of sporting games. The system 
can be used for many different types of games, from tennis, volleyball, soccer or 
hockey, to sports not involving balls but requiring the clear identification of 
boundaries. The process can be adopted to evaluate and judge the adherence to 
the given rules of a sport. 
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In one aspect of the invention there is provided a system for judging 
boundary lines on a court in sporting games, for determining whether a ball in play 
bounces in or out of court. The system comprises at least one camera to capture 
movement of the ball and a frame grabber associated with each of the cameras to 
process the movement as captured frames. An image processing system is 
configured to receive the captured frame from the frame grabbers and to process 
the captured frame as Images to determine whether the bail is in or out of court 
and to generate a signal if the ball is out of court. There is an output device 
coupledtotheimage processing system to receivethe signal and alert theplayers. 

In another aspect of the Invention, the cameras are equipped with auto-iris 
lenses to automatically adjust the aperture of the cameras. 

In another aspect of the invention, the camera may be color or high speed 
black and white. 

in another aspect of the invention, the image processing system comprises 
a calibration sub-system and a recognition sub-system. 



In another aspect of the invention, the calibration sub-system comprises a 
line recognition module, an image segmentation and region grouping module a 
court line and region registration module, a supervised ball recognition module and 
-5 a look-up-table module 

In another aspect of the invention, the recognition sub-system comprises a 
frame/sequence control module, a motion tracking module, an unsupervised 
automatic ball recognition module, a trajectory fitting module, a bounce detection 
>0 module and an in/out judge module. 
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In another aspect of the invention, there is provided a method of judging 
boundary lines on a court in sporting games in order to determine whether a ball 
in play bounces in or out of court in which the method utilizes at least one camera 
to capture movement of the ball, a frame grabber associated with each of the 
cameras to process the movement as captured frames and an image processing 
system configured to receive the captured frame from the frame grabbers and to 
process the captured frame. The method comprises the steps of: 

selecting a mode of game using an Input device configured so as to control 
the system and commence a recognition sub-system; 

during play of the game, continuously capturing image frames from the 

frame grabbers; 

within the image frames locating and isolating moving objects; 

comparing the moving objects to a calibrated image of the ball so as to filter 
out any moving object which is not the ball; 

fitting a path of the ball into a connected trajectory; 

detecting a spot on the court where the ball bounces by locating within the 
trajectory a sudden change In direction and by fitting or calculating the coordinates 

of the bounce; 

detennining whether the ball is in or out of court; 

transferring a signal to an output device if the ball is determined to be out 
of court. 

RRIEF DESCRIPTION OF T HE DRAWINGS 

These and other advantages of the Invention will become apparent upon 
reading the following detailed description and upon referring to the drawings in 
which:- • 

FIGURE 1 is a perspective view of an embodiment of the invention, in situ 
at a tennis court. 



FIGURE 2 is a front plan view of control panel of tine present invention. 
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inventiol'^^'^^ ^ ^ blockdiagram of the Imagaprocessing system of the present 

/^'QUR^S4to10arealternateschematicviewsofamappedtenniscourt 
for use with the embodiment of the invention shown in Figure 1 . 

FIGURE 1 1 is a logic flow diagram for setting functions of the image 
processing system before use of the embodiment of the invention shown In Figu^^ 

FIGURES 12 and 13 are altemate logic flow diagrams for ih* = , . 
processing system during play of the game. 



^While the Invention will be described in conjunction with illustrated 
embodiments, it will be understood that It Is not intended to limit the invention to 
such embodiments. On the contrary, it is intended to cover all alternatives, 
modifications and equivalents as may be included within the spirit and scope of the 
invention as defined by the appended claims. 



in the following description, similar features in the drawings have been 
given similar reference numerals. ' 

Tuming to the drawings. Figure 1 illustrates a system 2 forjudging 
boundaiy lines 4 on a court 6. Illustrated for the purposes of this application as 
a tennis court, for detennlning whether a ball (not shown) in play on the court 6 
bounces in or out of play. Although a tennis court has been illustrated, it will be 
apparent to those skilled in the art that the system may be used for many 
different types of games, from tennis, volleyball, soccer or hockey, to sports not 
involving balls but requiring the clear Identification of boundaries 
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The system 2 comprises color or high speed black and white cameras 10 
mounted near the court 6 in such a way that the field of view of the cameras 10 
covers the boundary lines 4 of the court 6. One possible location for positioning 
the cameras 10 is in line with the net 12 at the centerline of the court 6. so that 
two cameras 10 may be used, one to cover each side 14.16 of the court 6. 
Preferably, the cameras 10 would be mounted approximately 3 to 5 meters 
above court level. The cameras 10 may also be mounted In line with the 
service lines 18. 20 on respecHve sides 14, 16 of the court 6. Alternate 
placement for the cameras would be possible, in order to maximize the field of 
view of the cameras 10. while minimizing the number of cameras required. It is 
contemplated that two cameras would be preferable, but up to four cameras 
would also be possible. 

The cameras 10 are preferably equipped with auto-iris lenses which 
automatically adjust the aperture of the lens. This allows for consistent shutter 
speed even when the ambient light may change, for example direct sun vs. 
shadow, or sunlight vs. artificial light. 

Black and white or color cameras could be used for recreational clubs 
and games where the speed of play is not as high as in professional 
tournaments. For the latter application, a black and white system will be 
preferable using progressive scan technology to provide sharper images. 

A frame grabber which is associated with each camera 10 in order to 
convert the image into computer readable form captures the image from the 
camera 10. The captured image can then be manipulated by the image 
processing system in the manner described more fully below. 

The cameras 10 are electronically linked to a control panel 24, which 
control panel may house the image processing system, as well as the control 
buttons and output indicators to relay an out signal to the players. As seen in 
Figure 2, the output devices can be indicator lights 26 or an audio indicator. 
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Illustrated by button 28. The function of the i^et buttons 30 and the general 
reset button 32 shown on the control panel 24 will be deschbed In more detail 

below. The control panel 24 can be remote, iemote touch sc^en. voice 
command, attached or built-in. 

reference tothe block diagram of the image processing system 
Shown in RgutB 3, it can be Seen that the processing system is divided into 2 
pnncple parts, the calibradon sub-system and a recognition sub-system Tl.e 
block diagram indicates the data flow and logic flow within the two sub-systems. 

In the embodiment shown for use on a tennis court, the calibration sub- 
system ,s comprised of a line recognition module, an image segmentation and 
region grouping module, a court line and ragion module, a supervised ball 
recognition module and look-up table module. 

^ The calibration sub-system is a supervised process, which occurs 
whenever the camera parameters are changed. Its purpose is to register the 
positions Of boundary lines 4, namely the sidelines, the sen/ice lines and base 
hnes of the court 6 so that the processing system may detem,ine whether the 
ball IS m or -out" in operation of the system. The processing system will 
recognize all the boundary lines in the image in off-line (non-real time) mode 
Then the operator will use a pointing device, such as a mouse, to select ihe 
lines that correspond to the sidelines and base lines of the court. Under normal 
circumstances, a single calibration is all that is required, unless the camera 
parameters have changed. 

The line racognition software module is conflgured to recognize lines (for 
example, tennis court lines) ih the images. Ideally the lines shouW be straight 
However, due to possible camera distortion (for example, an Image rasulting ' 
from awide angle) and possible noise or interference, the lines can appear to 
1« broken curve segments in the digital images. The edge detection method 
which uses a set of curve partitioning and gnDupIng rules based on the 
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perceptual organization of descriptive curve features, is therefore adopted. It 
tracks curve segments and joins them into an appropriate form of a curve 
structure according to its topological and geometrical properties. It also takes 
into consideration all variable lighting conditions. The operator will nonetheless 
be able to correct possible errors in the automatic recognition and identify the 
correct lines. 

Once the sidelines and the base lines of the court are correctly 
recognized, the image segmentation and region grouping module is configured 
to record the In and out areas of the court based on input from the user. 

The court line and region registration module saves the locations of the 
"In" and "out" regions given by the previous process in its permanent memory 
(hard drive). Whenever the real-time tracking system starts up. it will first check 
these registered regions. These registered values are valid unless the camera 
parameters are changed. The camera parameters include extrinsic parameters 
(the camera position and orientation) and intrinsic parameters (focal length, lens 
distortion and CCD grid sizes). A typical court mapping is shown In Figure 4. 
Each area shown is a minimum of 0.5 meters in length and as the court layout 
requires in length. Areas 40. 42 and 44 are considered in singles play and 
areas 40. 46 and 48 are considered in doubles play. Similarly, Figure 5 shows 
the out areas after the initial serve in singles play and Figure 6 shows the out 
areas after the initial serve in doubles play. 

The supervised ball recognition module is another supervised process. In 
this process, a tennis ball will be put into the scene. The operator will click on 
the ball in the scene. The module is then configured to record the color or grey 
level range pattern of the ball. 

The look-up-table module is configured to transfomn input image data 
into output data. For gray level frame grabbers, it is a 256-bytes table; for tnie 
color frame grabbers, the look-up table module is implemented as a mapping 
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function. The purpose of applying the look-up table module Is to maximize the 
intensity of the tennis ball while minimizing the intensity of the stationaiy 
background in the process of recognition. Hardware based look-up table 
modules can make the real time tracking and recognition easier. 

^ Once the calibration sub-system is complete, the system is ready for use 
Such use is described in the block diagram of the recognition sub-system, shown 
.n Figure 3. In the embodiment shown, the recognition sub-system comprises a 
frame/sequence control module, a motion tracking module, an unsupervised 
automatic ball recognition module, a trajectory-fitting module, a bounce detection 
module and an in/out judge module. 

The frame/sequence control module is configured to control the image 
grabbing timing in order to obtain continuous image frames from the frame 
grabbers. It is desirable, but not mandatory, that a complete or almost complete 
.mage sequence Is captured both for recognizing the tennis ball and for locating 
the trajectory (course) of the ball. 

The motion-tracking module is configured to be triggered by any moving 
Objects Within the image sequence captured for the scene. The module is then 
configured to locate and isolate any moving objects from the background in the 

.mage frames. All objects found undermotion will be passed to the ball recognition 
module. 

The unsupervised automatic ball recognition module is based on the 
supervised ball calibration and the result of motion tracking. The module is 
configured to recognize all moving objects that are potentially tennis bails in the 
.mages. Unrelated moving pattern (possibly a tennis player, or. a bird that 
happens to fly by) should be filtered out. 

At this stage in the process, the motion-tracking module and the 
unsupemsed ball recognition module have captured a complete or almost 
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complete course of the tennis ball. However, due to the cannera view being blocked 
by a player or to the use of different shutter speed, there may be broken parts of 
the trajectory. Thus, the trajectory-fitting module is configured to fit the running 
course of the tennis balls into connected lines or curves. 

Using the shape of the ball's trajectory, the bounce detection module is 
configured to detect the spot of bouncing by finding the sudden change of direction 
in the trajectory or by calculation, which is considered as the bouncing point on the 
ground of the tennis ball. 

The bounce is then passed to the in/out judge module, which is configured 
to determine whether the bounce Is in or out based on a simple set of rules. Such 
rule set may include: 

- if the bouncing spot overlaps with side lines or base lines, and inside the 
region that is registered in calibration, it is "in"; or 

- if the bouncing spot does not overlap with the lines, and outside the 
registered region, it is "out". 

Figure 1 1 illustrates the logic flow for presetting the system before play of 
the match begins, using the control panel. This will not change during the match, 
unless the players or the administrator (tournament) oven-ide the initial settings. 
These functions have to be set before starting a tennis match and likely not change 
until finished. The Singles / Doubles - sets the system to scan either as singles 
(Fig.5) or doubles (Fig.6) after the serve or according to timer if timer setting is 
•ON". The timer option gives tiie fiexibility for setting the system to monitor the court 
in either singles or doubles mode simultaneously without issuing any additional 
command (Reset #1 on Figure 12. The logic flow diagrams 13 would thus no 
longer be applicable to the operation of the system). The system will indicate if a 
ball bounces OUT, pauses for 5 sec while keeping the indicator ON, then starts 
monitoring again. If this option is chosen the system only monitors as shown In 
figures 5 or 6 and does not monitor the service areas, figures 7 through 10. 
Therefore the service lines would have to be judged by the players. This is a very 
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convenient way for clubs using the system on several tennis courts - once the 
system is set to this option ft does not need any further adjustment and will watch 
the lines uninten-upted. 



the lines unihten-upted 

'f*««'^«r'^n'*°n is set to off, men the system functions according to the 
log,c shown in figures 12 and 13. In that mode, i.e. Umer function deactivated it 
.s preferable to have a voice command at the control panel in order to reset the 
systemfbrthe next rally. For tournaments, the system should be monitoi^d by an 
adm,n,st,Btor, by the chair umpire or a by line Judge to ensure pn,per system 
setting after each out has been recorded, or to be hooked up to the offioial 
scoreboard (see the table on page 15). 

Figure 12 illustrates the logic flow for the system monitoring the court 
after the sen,ice, according to the mode chosen, singles or doubles, i.e. figure 5 
or figure 6 (or reset #1 (play) If flmer mode Is prefen-ed). The system monitors 
the court until an OUT occurs, tums the appropriate indicator on, keeps it on 
and waiB forthe next reset command. The reset #6 command turns all 
.ndroato., off and waits for the next reset command. If the audio function is set 
on , ,n addition to the out indicators, a short (0.5 sec) sound will be given upon 
art OUT 

Figure 13 Illustrates the logic flow for the system when set to monitor the 
service areas, as shown in Figures 7 to 10 and continues from Figure 12. at "1". 

In Reset #2, the serve is coming from side 'B' and should bounce in side 'A' 
even sen/ice court. The system looks forthe firet bounce on side 'A'. If the bounce 
was inside the even service court, including the lines (Figure 7). the system starts 
mon,torin& according to the preset singles/doubles option, as on Figure 12 
continuing from "1". If the first bounce was not in the even service court the side 
A service indicator will go on and will be kept on until the next reset command is 
issued, 
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Applicable scores and voice commands for this function include: 0:0; 15:15 
•Fifteen all'; 30:30 Thirty all'; 40:40 'Forty all'; 15:40 'Fifteen forty'; 40:15 'Forty 
fifteen'; deuce 'Deuce'. Preferably, the player will also be able to initiate a 'Reset 
#2' with the voice command 'A even' (for tiebreaker etc.) 

In Reset #3, the serve Is coming from side 'B' and should bounce in side 'A' 
odd service court. The system looks for the first bounce on side 'A'. If the bounce 
was inside the odd service court, including the lines (Figure 8), the system starts 
monitoring according to the preset singles / doubles option. If the first bounce was 
not in the odd service court the side A service indicator will go on and will be kept 
on until the next reset command is issued. 

Applicable scores and voice commands include "15:0 'Fifteen love'; 0:15 
'Love fifteen': 30:15 Thjrty fifteen'; 15:30 'Fifteen thirty'; 40:30 'Forty thirty'; 30:45 
•Thirty forty'; ad In (advantage In) 'Ad in'; ad out (advantage out) 'Ad out'. The 
player will also be able to initiate a 'Reset #3' with the voice command 'A odd' (for 
tiebreaker etc.) 

In Reset #4, the serve is coming fi-om side 'A' and should bounce in side 'B' 
even service court. The system looks for the first bounce on side 'B'. If the bounce 
was inside the even service court, including the lines (Figure 9), the system starts 
monitoring according the preset singles / doubles option. If the first bounce was not 
in the even service court the side B service indicator will go on and will be kept on 
until the next reset command is issued. 

Applicable scores and voice commands include: 0:0; 15:15 'Fifteen all"; 
30:30 "Thirty all'; 40:40 'Forty all'; 15:40 'Fifteen forty'; 40:15 'Forty fifteen'; deuce 
'Deuce'. The players will also be able to initiate a 'Reset #4' with the voice 
command 'B even* (for tiebreaker etc.) 



In Reset #5, the serve is coming from side 'A' and should bounce in side 'B' 
odd service court. The system looks for the first bounce on side *B'. If the bounce 
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was ,ns,de the odd service court, including the lines (Figure 10). the system starts 
monitonng according the preset singles / doubles option. If the first bounce was not 
.n the odd service court the side B service indicator will go on and will be kept on 
until the next reset command is issued. 

Applicable scores and voice commands include: 1 5:0 'Fifteen love'- 015 

^ove fifteen^ 30:15 Thirty fineen': 15:30 fifteen thirty'; 40:30 -Forty thirt^^ 
Thirty forty; ad in (advantage in) 'Ad in'; ad out (advantage out) 'Ad out' The 
players v.ill also be able to initiate a 'Reset#5' with the voice command 'B odd' (for 
tiebreaker etc.) 

In a preferred embodiment therefore, two cameras 10 monitor the two sides 
of the court 6. Before the match begins, the players choose the mode 
(singles/doubles), set the timer on or off and set the audio on or off Also the 
players will be able to choose voice command or manual commands for the reset 
functions. 

The cameras 1 0 then monitor play on the court and frame grabbers (one per 
camera) digitize the image for the processing system. The moving objects within 
the image are isolated and. comparing the objects to the calibrated image of the 
ball, all but the ball are filtered out. The path of the ball is then fitted into a 
connected trajectory and. by locating a sudden change in the direction of the 
trajectory, the bounce of the ball is detected. Following the logic flows set out 
above, the bounce is detemiined to be in or out. and if out. a signal is triggered on 
the control board. The board then actuates the appropriate audible and/or visual 
cue to indicate that the ball bounced out of court. The system is then reset 
manually or by a timed reset and continues to monitor the court. 

It will be readily apparent to the skilled person in the art that where the 
system is being used in tennis matches involving a chair umpire, or other activities 
involving an official overseeing the game, the control board and reset functions can 
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easily be monitored and controlled by that umpire or official. Thus, the use of the 
timer and audible functions are optional. 

In matches where the players are on their own, the combination of the timer 
function and the audible signal allow play to continue relatively unabated. Indeed, 
the system can have its own independent scoreboard or can be hooked up to the 
official scoreboard at the court. The following chart represents sample 
scoreboard/reset logic for automatic resetting of the system in response to a 
scoreboard change: 
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Thus, it is apparent that there has been provided in accordance with the 
invention a system and method for judging boundary lines that fully satisfies the 
objects, alms and advantages set forth above. While , the invention has been 
described In conjunction with Illustrated embodiments thereof, it is evident that 
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many alternatives, modifications and variations will be apparent to those skilled In 
the art in light of the foregoing description. Accordingly. It is intended to emb 
all such alternatives, modifications and variations as fall within the spirit and r.. 
scope of the Invention. 
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LCLAiMl 

1. A system for judging boundary lines on a court in sporting games for 
detemiining whether a ball in play bounces in or out of court; said system 
comprising; 

at least one camera to capture movement of said ball; 

a frame grabber associated with each of said at least one cameras 

to process said movement of said ball as captured frames; 

an image processing system configured to receive said captured 

frame from said frame grabbers and to process said captured frame 

as images to determine whether said ball is in or out of court and to 

generate a signal if said ball is out of court; 

an output device coupled to said image processing system to receive 

said signal. 

2. The system of Claim 1 wherein said cameras have a shutter speed of at 
least 1 /60th of a second. 

3 The system of Claim 1 comprising at most four cameras. 



4. 



5. 



6.. 



The system of Claim 1 wherein said cameras are equipped with auto-iris 
lenses to automatically adjust the aperture of the cameras. 

The system of Claim 1 wherein said cameras may be color or black and 
white. 

The system of Claim 1 comprising two cameras wherein said cameras are 
positioned on opposite sides of a centeriine transversely dividing said court 
into two sides, each of said cameras mounted approximately 3 to 5 metres 
above said court and positioned so as to monitor at least all of the 
boundary lines on one side of the centeriine. 
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7. 



8. 



9. 



10, 



11. 



12. 



13. 



14. 



The system of Claim 6 wherein said cameras are positioned so as to be 
aligned with said centerline. 

The system of Claim 1 wherein said caph^red frames comprise the images 
ofsa-dball i^^o^ied by ohe of said cameras, Wherein said images are 
converted into a continuous line to illustrate the trajectory of the ball. 

The system of Claim 1 wherein said image processing system comprises 
a calibration sub-system and a recognition sub-system. 

ThesystemofClaimgwhereinsald calibration sub-systemcomprisesaline 
recognition module, an image segmeiitatibn and region grouping module 
a court l,ne and region ragistratlon module, a supervised ball racognition 
module and a look-up-table module. 

me system of Claim 10 wherein said line recognition module is configured 
to recognize and racort said boundary lines in said images, using a method 
of edge detection to oonect for distortions. 

The system of Claim 10 wherein said image segmentation and ragion 
grouping module is configured to record In and out araas of the court based 
on input from the user. 

The system of Claim 10 whenein said court line and region mgistration 
module is configurad to save in and out araas of the court in pen^anent 
memory to be used as a comparison point each time the system is 
commenced. 

The system Of Claim lOwherein said supen,ised ball recognition module is 
configured record as a calibrated image a colorpattem of the ball placed in 

the Image. 
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1 5. The system of Claim 1 0 wherein said look -up-table module is configured 
to transform input data into output data. 

1 6. The system of Claim 1 5 wherein said look-up-table module is configured as 
a 256 bytes table. 

17. The system of Claim 1 5 wherein said look-up-table module is configured as 
a mapping function. 

18. The system of Claim 9 wherein said recognition sub-system comprises a 
frame/sequence control module, a motion-tracking module, an 
unsupervised automatic ball recognition module, a trajectory fitting module, 
a bounce detection module and an in/out judge module. 

19. The system of Claim 16 wherein said frame/sequence control module is 
configured to control timing of image capture such that continuous image 
frames are captured from said frame grabbers. 

20. The system of Claim 1 8 wherein said motion-tracking module is configured 
to locate and isolate moving objects within said Image and pass said 
moving objects to the unsupervised automatic ball recognition module. 

21. The system of Claim 18 wherein said unsupervised automatic ball 
recognition module is configured to compare moving, objects within said 
Image to a calibrated image of said ball so as to filter out any moving 
objects which is not the ball, thereby leaving an image of the ball. 

22. The system of Claim 20 wherein said unsupervised automatic ball 
recognition module is configured to compare said moving objects within said 
image to a calibrated image of said ball so as to filter out any moving 
objects which is not the ball, thereby leaving an image of the ball. 
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26. 



23. The system of Claim 18 wherein said trajectory fitting module is configured 
to fit a path of said ball into a connected trajectory. 

24. The system of Glaim 22 wherein said trajectory fitting module is configured 
to fit a path of said ball Into a connected trajectory. 

25. The system of Claim 18 wherein said bounce detection module is 
configured to detect a spot on the court where the ball bounces by locating 
a sudden change in the direction of the ball. 

The system of Ciaini 24 wherein said bounce detection module is 
configured to detect a spot on the court where the ball bounces by locating 
within said connected trajectory a sudden change in the direction of the ball. 

The system of Claim 18 wherein said In/out judge module is configured to 
determine whether the ball has bounced in or out of court. 

The system of Claim 26 wherein said in/out judge module is configured to 
determine whether the ball has bounced in or out of court by comparing the 
spot on the court where the ball bounces to the boundary lines and 
determining if the spot overlaps with the lines or does not overlap with the 
lines, 

29. The system of Claim 1 further^omprising an Input device to select a mode 
of the game and selectively actuate and reset said system. 

30. The system of Claim 29 wherein said input device comprises voice 
activated commands. 

31. The system of Claim 29 wherein said input device comprises manually 
operable switches. 



27. 



28. 



3232A2_I 



wo 02/053232 



-20- 



PCT/CAOl/01830 



32. The system of Claim 29 wherein said input device comprises remotely 
operable switches. 

33. The system of Claim 29 wherein said input device comprises remote touch 
screen operable switches. 

34. The system of Claim 29 wherein said input device comprises separate wire 
connected operable switches. 

35. The system of Claim 29 wherein said input device and said output device 
are housed within a single control unit. 

36. The system of Claim 1 wherein said output device comprises an audible 
cue, activated upon receipt of said signal. 

37 The system of Claim 1 wherein said output device is housed within a 
scoreboard, 

38. The system of Claim 1 wherein said output device is wired to an existing 
scoreboard. 

39. The system of Claim 1 wherein said output device comprises an visual cue, 
activated upon receipt of said signal. 



40. 



A method of judging boundary lines on a court in sporting games in order 
to determine whether a ball in play bounces in or out of court, said method 
utilizing at least one camera to capture movement of said ball, a frame 
grabber associated with each of said at least one cameras to process said 
movement as captured frames and an Image processing system an^nged 
to receive said captured frame from said frame grabbers and to process 
said captured frame, said method comprising the steps of. 

selecting a mode of game using an input device configured so as to 
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41. 



42. 



control said system and commence a recognition sub-system; 
during play of said game, continuously capturing Image frames from 
said frame grabbers; 

within said Image frames locating and Isolating moving objects; 

comparing said moving objects to a calibrated Image of said ball so 

as to filter out any moving object which is not said ball; 

fitting a path of said ball into a connected trajectory; 

detecting a spot on said court where the ball bounces by locating 

within said trajectory a sudden change in direction; 

determining whether said ball Is in or out of court; 

transferring a signal to an output device If said ball is detemiined to 

be out of court. 

The method of Claim 40 further comprising an Initial calibration sequence 
perfomied when said system Is Initially set up at said court or when 
configuration of said cameras has changed. 

The method of Claim 41 wherein said calibration sequence comprises the 
steps of recognizing and recording said boundary lines in said images 
recording in and out areas of said court, saving said In and out areas in 
permanent memory, recording a color or grey level range pattern of said 
ball, and creating a look-up table to transfomi Input data Into output data 
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